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Description 

This invention relates to product inspection meth- 
ods and apparatus, and more particularly to a method 
and apparatus for optically determining whether or not 5 
a product has an acceptable appearance. 

For many products such as consumer goods like 
packaged foods, beverages, cleaning products, health 
and beauty aids, cigarettes, cigars, etc., it is very impor- 
tant that the external appearance of the product or its 10 
packaging be uniform and defect-free. Yet these prod- 
ucts are typically produced in such large quantities and 
at such high speeds that some form of automated optical 
inspection is practically essential. It is highly desirable 
for an optical inspection system to be able to test all or is 
substantially all parts of the product image so that de- 
fects of any kind occurring anywhere in the image can 
be detected. At the same time the inspection system 
should not reject products having minor but acceptable 
deviations from the ideal product. 20 

For even a relatively simple product image such as 
a cigarette pack, an inspection system must be initially 
supplied with a tremendous amount of information in or- 
der to enable the system to inspect all or substantially 
all portions of the image with the sophistication required 2S 
to discriminate between acceptable products (i.e., prod- 
ucts having the ideal appearance or an appearance ac- 
ceptably close to the ideal) and unacceptable products 
which should be rejected because of defects in appear- 
ance or appearance which is not sufficiently close to the 30 
ideal. Identifying and entering this information into the 
inspection system apparatus typically requires a very 
high level of skill and/or large amounts of operator time. 
Moreover, this data identification and entry task must be 
repeated each time a new or even slightly different prod- 35 
uct is to be inspected. Such an inspection system is re- 
vealed in EP-A-0 382 466. 

The present invention aims to improve and simplify 
optical inspection systems. 

Accordingly, there is provided a method of deter- 40 
mining the acceptability of a product by generating a fil- 
ter (F) from a first set of acceptable images (I) of the 
product, comparing the filter with each of a second set 
of images of the product to produce a processed value 
(P) for each image in the second set, the processed val- 4S 
ues having a distribution of values, comparing the filter 
with each of a third set of images of the product to pro- 
duce a further processed value for each image in the 
third set, and comparing each further processed value 
to the distribution to determine the acceptability of the so 
product associated with the image having the further 
processed value, characterized by: 

generating from the distribution a first range (A) and 
a second range (B) of processed values, the first 55 
range comprising processed values associated 
with acceptable images of the product, and the sec- 
ond range being spaced from said first range and 



comprising processed values associated with unac- 
ceptable images of the product; 
determining whether each further processed value 
is outside both of the first and second ranges and, 
if so, selecting the associated image only if said im- 
age is acceptable; and 

adaptrvely training the filter with the selected image 
to produce a modified filter whereby comparison of 
the modified filter with the selected image produces 
a modified processed value closer to the first range. 

The invention also provides apparatus for determin- 
ing the acceptability of a product by generating a filter 
(F) from a first set of acceptable images (I) of the prod- 
uct, comparing the filter with each of a second set of 
images of the product to produce a processed value (?) 
for each image in the second set, the processed values 
having a distribution of values, comparing the filter with 
each of a third set of images of the product to produce 
a further processed value for each image in the third set, 
and comparing each further processed value to the dis- 
tribution to determine the acceptability of the product as- 
sociated with the image having the further processed 
value, characterized by: 

means for generating from the distribution a first 
range (A) and a second range (B) of processed val- 
ues, the first range comprising processed values 
associated with acceptable images of the product, 
and the second range being spaced from the first 
range and comprising processed values associated 
with unacceptable images of the product; 
means for determining whether each further proc- 
essed value is outside both of the first and second 
ranges and, if so, selecting the associated image 
only if said image is acceptable; and 
means for adaptively training the filter with the se- 
lected image to produce a modified filter whereby 
the comparison of the modified filter with the select- 
ed image produces a modified processed value 
closer to the first range. 

Embodiments of the invention have the advantage 
that they may greatly reduce the level of operator skill 
and amount of operator time required to set up the sys- 
tem to inspect a new or different product. 

In a preferred embodiment of the invention an opti- 
cal inspection system forms an initial discriminant func- 
tion or "titter" from a composite of a relatively small 
number of "first phase" images which the operator of the 
system determines to be acceptable images. A relative- 
ly simple technique (e.g., a logical OR function) is pref- 
erably used to form this composite. The ability to pro- 
duce the initial discriminant function quickly using such 
a simple combination of a small number of images fa- 
cilitates rapid "start-up" of the system. Thereafter the 
system uses the initial discriminant function to process 
a relatively large number of representative "second 
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phase" images in order to compute statistical informa- 
tion about the images in relation to the initial discriminant 
function. In particular, the system uses the injtial discri- 
minant function to compute a processed value for each 
second phase image. These processed values will typ- 
ically have an approximately normal or Gaussian distri- 
bution. The upper and lower limits of a central portion of 
this distribution containing a first statistically large 
number of the processed values are identified as first 
threshold values. The upper and lower limits of a central 
portion of this distribution containing a second statisti- 
cally even larger number of the processed values are 
identified as second threshold values. 

In a subsequent third phase of the operation of the 
system, the first and second threshold values are used 
in the processing of a relatively large number of "third 
phase" images. In particular, the system uses a discri- 
minant function (initially the above-mentioned initial dis- 
criminant function) to compute a processed value for 
each successive third phase image. If this processed 
value for a given third phase image is between the first 
threshold values, that third phase image is automatically 
used to refine (e.g., using a Widrow-Hoff-type adaptive 
training process) the discriminant function for subse- 
quent use. If the processed value for a third phase image 
is not between the second threshold values, that third 
phase image is automatically discarded. As a third pos- 
sibility, if the processed value for a third phase image is 
not between the first threshold values but is between the 
second threshold values, the operator of the system is 
given the choice as to whether or not that image should 
be discarded (i.e., because the image looks unaccept- 
able) or used to refine the discriminant function for sub- 
sequent use (i.e., because the image looks acceptable). 

When the third phase is completed, the system is 
ready for actual product inspection using the refined dis- 
criminant function and the first threshold values. In ac- 
tual product inspection, the system uses the refined dis- 
criminant function to compute a processed value for 
each product image. If the processed value for a product 
image is between the first threshold values, the product 
is accepted as having an acceptable appearance. If the 
processed value for a product image is not between the 
first threshold values, the product is rejected as having 
an unacceptable appearance. 

The system greatly reduces the level of operator 
skill and amount of operator time required to set the sys- 
tem up for a product inspection task. The operator is only 
required to identify a relatively small number of accept- 
able images (e.g., 25) during the first phase. The initial 
discriminant function is then computed automatically us- 
ing a simple and rapid technique such as a logical OR 
of the small number of first phase images. The entire 
second phase may also be automatic. And during the 
third phase, the operator is only required to decide on 
the acceptability of the relatively small number of imag- 
es whose processed values fall outside the first thresh- 
old values but between the second threshold values. 



An embodiment of the invention will now be de- 
scribed by way of example, and with reference to the 
accompanying drawings in which: 

5 FIG. t is a simplified schematic block diagram of an 
illustrative embodiment of an optical product in- 
spection apparatus embodying the invention; 
FIGS.2a and 2b (referred to collectively as FIG. 2) 
are a flow chart of an illustrative optical product in- 
fo spection method embodying the invention; 

FIGS.3a-3c (referred to collectively as FIG. 3) are a 
flow chart showing in greater detail, the first training 
phase shown in FIG. 2; 

FIGS.4a and 4b (referred to collectively as FIG.4) 
is are a flow chart showing in greater detail, the sec- 
ond training phase shown in FIG.2; 
FIGS.5a-5c (referred to collectively as FIG. 5) are a 
flow chart showing in greater detail the third training 
phase shown in FIG.2; 
20 FIG. 6 is a flow chart showing in greater detail the 
product inspection steps show in FIG. 2; 
FIG.7 is a diagram of a dot product spectrum which 
is useful in explaining certain features of the em- 
bodiment described; 
2S FIG. 8 is a histogram diagram useful in explaining 
certain features the embodiment described; and 
FIG. 9 shows several equations which may be em- 
ployed in the embodiment of the invention. 

30 As shown in FIG. 1 , a typical product inspection sys- 
tem 10 constructed in accordance with this invention in- 
cludes conveyor apparatus 20 for conveying the objects 
or products 12 to be inspected, one after another, from 
left to right as viewed in the FIG. Each time conventional 

35 product sensor 22 detects a product 12 at a predeter- 
mined location A opposite conventional camera 24, con- 
ventional processor 26 (which includes conventional im- 
aging hardware) causes conventional light sources 30 
to briefly illuminate the product, thereby allowing cam- 

40 era 24 to capture what is effectively a still image of the 
product. This still image is fed to processor 26 which 
digitizes and further processes the image. Processor 26 
is augmented by conventional video display 32 and con- 
ventional data entry device 34 (e.g., a keyboard, mouse, 

45 and/or touch screen elements associated with display 
32). Processor 26 can cause display 32 to display a 
product image captured by camera 24, and can aug- 
ment that display with other information such as the out- 
line of an acceptable product image and/or outlines of 

50 certain features of an acceptable product image. The 
operator may use this augmenting information to help 
determine whether the product image being displayed 
is acceptable. The operator may use data entry device 
34 to control the overall operation of the system, as well 

55 as to respond to inquiries from the system (e.g., as to 
whether or not the operator judges the product image 
currently shown on display 32 to be acceptable). 

The system may be set up to perform a product in- 
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spection by operating it substantially as though it were 
inspecting products, i.e., by using conveyor 20 to con- 
vey representative products one after another past cam- 
era 24 and by using the other elements of the system to 
process the images of those products as described in s 
detail below. During actual product inspection, proces- 
sor 26 determines whether the image of each succes- 
sive product 12 is acceptable, and when that product 
reaches a controllable branch 20B in conveyor 20, proc- 
essor 26 controls that branch so that acceptable prod- 10 
ucts 12A are directed to accepted product conveyor 
20A, while unacceptable products 12R are directed to 
rejected product conveyor 20R. 

While FIG. 1 suggests that system 10 operates on 
a single elevational image of products 12, it will be ap- is 
parent to those skilled in the art that the system could 
be set up to test multiple images of the products taken 
from different angles and including perspective views so 
that as many surfaces of the objects are inspected as 
are desired. Similarly, although the system will be ex- 20 
plained in terms of monochrome (e.g., black and white) 
images, it will be apparent to those skilled in the art how 
the system can be modified to inspect in full color. Thus 
camera 24 may be a conventional NTSC or RGB com- 
patible camera. Processor 26 may be a suitably pro- 25 
grammed conventional 386 personal computer worksta- 
tion such as a CAT386 workstation available from 
Comark Corp. of Medfieid, Massachusetts with a con- 
ventional IM-1280 imaging hardware system available 
from MATROX Electronic Systems Limited of Dorval, 30 
Quebec, Canada. 

An overview of a preferred embodiment of the meth- 
od of this invention is shown in FIG. 2. Basically the de- 
picted embodiment comprises a training portion, includ- 
ing three successive phases 1 , 2, and 3 (shown in boxes 35 
1 00, 200, and 300, respectively), and actual product in- 
spection (shown in box 400). During the three training 
phases, the system "learns", by appropriately process- 
ing product images with appropriate but relatively limited 
input from the human operator of the system, how to 40 
discriminate between good and bad images. Thereafter, 
during actual product inspection, the system uses this 
■knowledge" to accept or reject products. 

In training phase 1 (step 100 in FIG. 2) an initial dis- 
criminant function F (which may be thought of as a two- 45 
dimensional matrix commensurate with the two-dimen- 
sional data for the product images or product image por- 
tions to be inspected) is formed from the data I for a 
relatively small number of "first phase" images. Al- 
though this initial discriminant function could be comput- so 
ed in many other ways in accordance with this invention, 
in the preferred embodiment (shown in detail in FIG. 3) 
a relatively simple technique (i.e., a logical OR of the 
phase 1 images) is used in order to allow a relatively 
small and inexpensive processor 26 to perform the nec- ss 
essary calculations without requiring more time than the 
operator of the system needs to provide the necessary 
inputs regarding each successive first phase image. Ac- 



cordingly, as shown in FIG. 3 training phase 1 starts with 
step 102, and in step 104 various program constants 
are initialized and inputs are read (e.g., from the memory 
which is part of processor 26 and/or from data entry de- 
vice 34). For example, step 104 may include selection 
of an image outline overlay to be displayed with product 
images on display 32 to help the operator judge the ac- 
ceptability of images. Step 104 may also include selec- 
tion of the boundaries of the portion or portions of the 
image to be processed. As another example, step 104 
may include selection of a threshold to be used in bina- 
rizing the image data as discussed below. Any other 
necessary system initialization tasks may be performed 
as part of step 104. 

In step 1 06 the system acquires the data for the first 
of the first phase images. This is done by having camera 
24 capture a product image as described above. Proc- 
essor 26 then digitizes this image in full gray scale and 
causes display 32 to display this gray scale image with 
any augmenting information (such as an outline overlay) 
selected in step 104. The operator then indicates (via 
data entry device 34) whether or not the displayed im- 
age is acceptable. If so, control passes to step 108. If 
not, step 106 is repeated with new product images until 
an image acceptable to the operator is found. 

In step 1 08 the first acceptable image is pre proc- 
essed. This preferably includes edge detecting the gray 
scale image so that pixels at or near significant changes 
in image brightness are emphasized (e.g., increased in 
value) relative to other pixels which are de-emphasized 
(e.g., decreased in value). Edge detection is a well- 
known technique which is discussed in more detail, for 
example, in European Patent Application EP-A- 
0382466 claiming priority from U.S. application serial 
number. 308,739, filed February 9, 1989. 

After edge detection, the edge detected image is 
preferably binarized so that ati pixels having values on 
one side of a predetermined binarization threshold level 
(which may have been selected in step 104) are as- 
signed one binary value (e.g., 1), while all pixels having 
values on the other side of the binarization threshold lev- 
el are assigned the other binary value (e.g., 0). 

In step 110 the initial discriminant function F is set 
equal to the first acceptable image data from step 108. 

In step 112 the sum of the dot products of the dis- 
criminant function and the phase 1 image data is initial- 
ized. Because at this point F and I are the same, the 
initial dot product of F and I is just the sum of the pixel 
values of i. 

In step 114 an index value i is set equal to 1. 

In step 116 the system acquires the next acceptable 
image. Step 116 is therefore an exact repetition of 
above-described step 106. 

In step 118 the data for the next acceptable image 
(acquired in step 116) is preprocessed exactly as de- 
scribed above in connection with step 108. 

In step 1 20 the initial discriminant function is updat- 
ed with the new image data by computing the logical OR 
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of the new image data and the old initial discriminant 
function data to produce a new initial discriminant func- 
tion. In other words, for each pixel location in which ei- 
ther or both of the image data and the old initial discri- 
minant function data are 1, the new initial discriminant 
data value is 1, while for each pixel location in which 
both the image data and the old initial discriminant data 
are 0, the new initial discriminant function data value is 
0. 

In step 122 the sum of the dot products of the dis- 
criminant function and the phase 1 image data is updat- 
ed for the current image. Because the 1 -valued pixel lo- 
cations in each image are always a subset of the 1 -val- 
ued pixel locations in F, each new dot product is just the 
sum of the pixel values in the current image I. 

In step 124 the index i is incremented by 1, and in 
step 1 26 the new value of i is tested to determine wheth- 
er it is greater than or equal to 25. This is an arbitrary 
number which determines how many first phase images 
will be used to compute the initial discriminant function. 
Although any other number could be used, 25 has been 
found to give good results. If i has not yet reached 25, 
control returns to step 116 and steps 116-126 are re- 
peated until the test in step 1 26 is satisfied and control 
consequently passes to step 128. 

In step 1 28 the average of the dot products of F and 
each of the first phase images is computed by dividing 
PSUM by 25 (the number of first phase images). 

In step 130 training phase 2 (step 200 in FIG. 2) 
begins. The initial discriminant function F from the last 
performance of step 120 and the average dot product 
are saved. 

In step 200 the initial discriminant function F is used 
to compute statistical information about the images be- 
ing processed. Again, although this can be done in other 
ways in accordance with this invention, a preferred em- 
bodiment of step 200 is shown in FIG. 4 and will now be 
described by way of illustration. 

Training phase 2 starts in step 202. In step 204 in- 
dex value i is set equal to 1, variable SUM is set equal 
to 0, and variable SUMSQRS (for sum of squares) is 
also set equal to 0. 

In step 205 the initial binary discriminant function F 
is converted to bipolar form using initial positive and 
negative values such that the final discriminant function 
values take advantage of the full arithmetic range of 
processor 26. To reflect this in the average dot product, 
the average dot product is also scaled by the same scale 
factor in step 205. For example, il processor 26 performs 
8-bit arithmetic with values between -128 and +127, the 
initial values now used in function F may be -50 (for pixel 
locations where the F value was formerly 0) and +50 (for 
pixel values where the F value was formerly 1 ), and the 
average dot product from step 1 28 may be multiplied by 
50. 

In step 206 a product image is acquired in a manner 
similar to above-described step 1 06, except that during 
training phase 2 the operator of the system is not re- 



quired to determine whether the image is acceptable. 
Accordingly, all the images received during phase 2 are 
used. These images can therefore be expected to ex- 
hibit the normal range of variation for the product images 

s that the system will subsequently encounter during ac- 
tual product inspection. In addition, because no interac- 
tion with the operator of the system is required during 
this phase, the phase 2 images can be processed much 
faster (e.g., at actual product inspection rates) than the 

10 phase 1 images. 

In step 208 the image data acquired in step 206 is 
preprocessed exactly as described above in connection 
with step 108. 

In step 210 the dot product P of the rescaled initial 

15 discriminant f unction F from step 205 and the image da- 
ta I from step 208 is calculated. This calculation involves 
multiplying the value of F at each pixel location by the 
value of I at that pixel location, and then summing all of 
the resulting products to produce the dot product P. 

20 Elsewhere in this specification the more generic term 
■processed value" is sometimes used for the dot product 
P. It , will be noted that if I is identical to F, P will be a 
certain number, but if I differs from F at certain pixel lo- 
cations, P will be greater or less than that number. The 

25 amount by which P differs from that number is a meas- 
ure of how much I differs from F. In practice, the values 
of P will typically exhibit an approximately normal (i.e., 
approximately Gaussian) distribution about some mean 
or average value. 

30 in step 212 the variable SUMSQRS is incremented 
by the square of the value of P from step 21 0, and the 
index value i is incremented by 1 . 

In step 214 the index value i is compared to an ar- 
bitrary number (e.g., 1000) which is the predetermined 

36 number of images to be processed in phase 2. Although 
any sufficiently large number of images can be proc- 
essed in phase 2, 1 000 images have been found to give 
good results. If the test in step 214 is not satisfied, con- 
trol returns to step 206 where processing of the next 

40 phase 2 image begins. When 1000 phase 2 images 
have been processed as described above, the test in 
step 214 is satisfied and control passes from step 214 
to step 216. 

In step 216 the index value i is reduced by 1 to re- 
45 verse the last incrementing of that value. 

In step 218 the rescaled average dot product from 
step 205 and the value of the SUMSQRS variable are 
used to compute the standard deviation of the previous- 
ly computed dot products. 
50 in step 220 two first threshold values and two sec- 
ond threshold values are selected so that the distribution 
of phase 2 dot products is subdivided by these threshold 
values as shown in FIG. 7. For example, the first thresh- 
old values may be chosen so that a fraction f1 of the dot 
55 products are greater than the upper one of these thresh- 
old values and the same fraction of dot products are less 
than the lower one of these threshold values. The frac- 
tion f1 is preferably significantly greater than one-half 
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the fraction of images which are expected to be defec- 
tive in order to minimize the possibility that any unac- 
ceptable images have dot products that are greater than 
the upper or less than the lower of these first threshold 
values. Images with dot products between the first 
threshold values are therefore automatically acceptable 
as indicated in FIG. 7. 

The second threshold values are chosen so that a 
smaller fraction f2 of the dot products are greater than 
the upper one of these threshold values and the same 
smaller fraction of dot products are less than the lower 
one of these threshold values. The fraction f2 is prefer- 
ably significantly smallerthan one-half the fraction of im- 
ages which are expected to be defective in order to min- 
imize the possibility that any acceptable images have 
dot products that are less than the lower or greater than 
the upper one of these second threshold values. Images 
with dot products outside the region bounded by the sec- 
ond threshold values are therefore automatically reject- 
able as "gross rejects' as indicated in FIG. 7. Images 
with dot products outside the region bounded by the first 
threshold values but inside the region bounded by the 
second threshold values are "marginal rejects" as indi- 
cated in FIG. 7. Operator intervention is required to de- 
termine whether such an image should be accepted or 
rejected. 

it may be convenient and appropriate to choose the 
threshold values described above assuming the distri- 
bution of dot products to be Gaussian as shown, for ex- 
ample, in FIG. 8, and therefore characterized by a stand- 
ard deviation (given by the equation in step 128). In that 
case, the thresholds can be defined by the equations 
shown in FIG. 9. The average dot product used in these 
equations is the rescaled average dot product from step 
205. The alpha coefficients used in these equations with 
the standard deviation are selected so as to achieve the 
target fractions f1 and f2 for a Gaussian distribution. 
These values can be readily selected with the aid of 
available tables of the properties of the Gaussian distri- 
bution. The most preferred approach is to select the first 
threshold values without assuming a Gaussian distribu- 
tion (i.e., as described prior to the above discussion of 
the Gaussian distribution), and to use the second meth- 
od (i.e., the Gaussian distribution assumption) to select 
the second threshold values. Note that in FIG. 8 the re- 
gion A corresponds to the "acceptable" region of FIG. 
7, the regions B correspond to the "gross reject" regions 
of FIG. 7, and the regions C correspond to the "marginal 
reject" regions of FIG. 7. Thus region A includes dot 
products known to be associated with clearly acceptable 
images, whereas regions B include dot products known 
to be associated with clearly unacceptable images. Re- 
gions C are those along the distribution of dot products 
P which may be marginally acceptable. Adaptive train- 
ing is performed in phase 3 as discussed below with re- 
spect to dot products lying in region A, and also with 
respect to dot products lying in regions C which the op- 
erator of the system determines to be acceptable. 



After the second threshold values are calculated in 
step 220, control passes to step 222 to begin training 
phase 3 (step 300 in FIG. 2). The first and second 
threshold values from step 220 are saved, as are F and 
5 the rescaled average dot product from step 205. 

In training phase 3 (step 300 in FIG. 2) the statistical 
information from phase 2 is used with the image data 
from another statistically significant number of images 
to refine the initial discriminant function R Again, al- 
to though this can be done in other ways in accordance 
with this invention, a preferred embodiment of training 
phase 3 is shown in FIG. 5 which will now be described 
by way of illustration. 

As shown in FIG. 5, training phase 3 begins in step 
15 302, and in step 310 an index value i is initialized to 0, 
and a counter - used during phase 3 to count the 
number of marginally acceptable images which the op- 
erator of the system decides to accept - is also initial- 
ized to 0. 

20 in step 312 a phase 3 image is acquired exactly as 
described above in connection with step 206, and in step 
31 4the data for this image is preprocessed as described 
above in connection with step 208. 

In step 316 the dot product P of the discriminant 

25 function and the image data from step 31 4 is calculated. 
In step 318 the dot product value P from step 316 
is compared to the second threshold values from step 
220. If P is outside the range bounded by these second 
threshold values, control passes to step 320 where the 

30 image is rejected and control is then returned to step 
312 to begin the acquisition and processing of the next 
phase 3 image. On the other hand, if P is in the range 
bounded by the second threshold values, control pass- 
es from step 318 to step 322. 

35 |n step 322 the valu e of P f rom step 31 6 is compared 
to the first threshold values from step 220. If P is outside 
the range bounded by these first threshold values, con- 
trol passes to step 324. Step 324 is reached whenever 
the image is neither automatically rejectable as unac- 

40 ceptable (because the associated dot product is outside 
the limits defined by the second threshold values), nor 
automatically acceptable (because the associated dot 
product is inside the limits defined by the first threshold 
values). Accordingly, in step 324 the operator of the sys- 

45 tern is asked to intervene and decide whether or, not the 
image is acceptable. The image is displayed on display 
32 (as in connection with step 106 above). If the operator 
responds (again as in connection with step 106) that the 
image is unacceptable, control passes to step 320 

so where the image is rejected, and thereafter processing 
of the next phase 3 image begins as described above. 
On the other hand, if the operator responds that the im- 
age is acceptable, control passes from step 324 to step 
326 where the counter nacc is incremented. Thereafter, 

55 control passes to step 328. Returning to the other 
branch from step 322, if P is not outside the limits de- 
fined by the first threshold values, the image is automat- 
ically acceptable and control passes directly from step 
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322 to step 328. 

Step 328 is performed only when the current third 
phase image has been determined to be an acceptable 
image. In most cases the system will have made this 
determination automatically because the dot product P 
lor the image is between the first threshold values and 
the image is therefore obviously acceptable. In a few 
cases, however, the operator will have been required to 
assist with this determination as described above in con- 
nection with step 324. Accordingly, for the most part the 
processing of images can proceed as rapidly during 
phase 3 as during phase 2. Only rarely will the operator 
be required to intervene as a result of the performance 
of step 324. Moreover, operator intervention should be 
required even less frequently as phase 3 proceeds and 
the discriminant function is progressively refined as will 
now be described. 

Step 328 begins the process of refining the rescaled 
discriminant function using the data from the image 
which has just been determined to be acceptable. This 
discriminant function refining process is repeated for 
each acceptable phase 3 image. In step 328 an "error" 
value equal to the difference between the average P val- 
ue from step 205 and P from step 316 is calculated. In 
step 329 a value N equal to the number of pixels which 
are "on" in the image data is calculated. In step 330 a 
correction value equal to the error value from step 328 
divided by the value of N from step 329 is calculated. In 
step 332 the binary image data for the current phase 3 
image is rescaled using the correction value from step 
330. In particular, each pixel value of 1 is changed to the 
correction value, while each pixel value of 0 is unaltered. 

In step 334 the rescaled discriminant function is re- 
fined by incrementing each pixel value by the value as- 
sociated with that pixel in the rescaled image data from 
step 332. Step 334 is an "adaptive training" step analo- 
gous to the Widrow-Hoff training algorithm sometimes 
used in signal processing (see, for example, B. Widrow 
and S.D. Steams, Adaptive Signal Processing , Pren- 
tice-Hall, Englewood Clifs, 1985). Accordingly, as step 
334 is performed for successive acceptable third phase 
images, the rescaled discriminant function becomes 
better and better at producing dot products (as in step 
316) which are clearly differentiated between those as- 
sociated with acceptable images (P within the range 
bounded by the first threshold values) and those asso- 
ciated with unacceptable images (P outside the range 
bounded by the second threshold values). Accordingly, 
as phase 3 progresses, there should be less and less 
need to perform step 324, and the amount of input re- 
quired from the operator of the system should decrease. 

In step 336 the index value i is incremented. In step 
338 this index value is compared to a phase 3 cut-off 
value (e.g., 2000 acceptable phase 3 images). If the in- 
dex value is less than the cut-off value, control passes 
from step 338 to step 31 2 where processing of the next 
phase 3 image begins. As soon as step 338 detects that 
the index value has reached the cut-off value, control 



passes from step 338 to step 340. 

In step 340 the ratio of the counter value nacc to the 
index value i is compared to a predetermined threshold 
value. If this ratio exceeds the threshold value, the sys- 
s tern is still tentatively rejecting too many images which 
the operator of the system has found acceptable in step 
324. This indicates that the discriminant function F is 
still in need of further refinement. Accordingly, control 
passes from step 340 to step 310 where the processing 
10 of another series of phase 3 images begins again. On 
the other hand, if the ratio in step 340 is less than the 
threshold, the refining of discriminant function F' is 
judged complete, and training phase 3 is concluded by 
passing control to step 342 where actual product inspec- 
ts tion begins (step 400 in FIG. 2). 

An illustrative embodiment of actual product inspec- 
tion (step 400 in FIG. 2) is shown in FIG. 6. This process 
begins with step 402, and in step 404 an image is ac- 
quired as in step 206. In step 406 the data for this image 
20 is preprocessed as in step 208. In step 408 the dot prod- 
uct P of the refined discriminant function from training 
phase 3 and the image data from step 406 is calculated. 
In step 410 P is tested to determine whether or not it is 
in the range between the first threshold values from step 
25 220. If so, the system deems the image acceptable and 
control passes to step 41 2 in order to accept the product 
(i.e., direct it to accepted product conveyor 20A in FIG. 
- 1). If the step 410 test is not satisfied, the system deems 
the image unacceptable and control passes to step 414 
30 in order to reject the product (i.e., direct it to rejected 
product conveyor 20R in FIG. 1)., After either step 412 
or 414, control returns to step 404 to begin processing 
of the next image. 

It will be understood that the foregoing is merely il- 
35 lustrative of the principles of this invention and that var- 
ious modifications can be made by those skilled in the 
art without departing from the scope of the invention. 
For example, each image formed by elements 24 and 
26 can be broken down into a plurality of predetermined 
40 segments, and the data for each of the segments can 
be separately processed just as the data for the whole 
image is processed in the foregoing discussion, During 
actual product inspection all segments must satisfy the 
test of step 410 in order for the product to be accepted. 
45 As another example of a modification within the scope 
of this invention, discriminant function F' can continue 
to be refined during actual product inspection by updat- 
ing it in accordance with any acceptable product image 
or images exactly as described above in connection with 
so training phase 3. In another modification within the 
scope of the invention bipolar values -1 and +1 are used 
instead of binary values throughout and the discussion 
of, for example, steps 1 08, 1 1 8, 208, 31 4 and 406 should 
be construed accordingly. It should be understood that 
55 both binary and bipolar values are merely examples and 
any other two values can be used instead and are within 
the scope of the invention. 
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Claims 

1. A method of determining the acceptability of a prod- 
uct (12) by generating a filter (F) from a first set of 
acceptable images (I) of the product, comparing the s 
filter with each of a second set of images of the prod- 
uct to produce a processed value (P) for each image 

in the second set, the processed values having a 
distribution of values, comparing the filter with each 
of a third set of images of the product to produce a 10 
further processed value for each image in the third 
set, and comparing each further processed value to 
the distribution to determine the acceptability of the 
product associated with the image having the fur- 
ther processed value, characterized by: w 

generating (220) from the distribution a first 
range (A) and a second range (B) of processed 
values, the first range comprising processed 
values associated with acceptable images of 20 
the product, and the second range being 
spaced from said first range and comprising 
processed values associated with unaccepta- 
ble images of the product; 
determining (318, 322, 324) whether each fur- 25 
ther processed value is outside both of the first 
and second ranges and, if so, selecting the as- 
sociated image only if said image is acceptable; 
and 

adaptively training (334) the filter with the se- 30 
lected image to produce a modified filter where- 
by comparison of the modified filter with the se- 
lected image produces a modified processed 
value closer to the first range. 

35 

2. A method according to Claim 1 , characterized in 
generating the filter from the first set of acceptable 
images of the product comprises combining (120) 
the first set of acceptable images using a logical OR 
operation. 40 

3. A method as claimed in Claim 2, further character- 
ized in that the step of combining the first set of ac- 
ceptable images includes the steps of: 

45 

edge detecting (1 08) each image; and 
associating (1 08) a first value with each portion 
of each edge detected image which has a value 
on one side of a predetermined threshold value, 
and associating a second value with all other so 
portions of each edge detected image prior to 
combining the images using the logical OR op- 
eration. 

4. A method according to Claim 3, characterised in 55 
that the first and second values are binary 0 and 1 . 

5. A method according to any of Claims 1 to 4, char- 



acterized in that the adaptive training of the filter is 
analogous to a Widrow-Hoff training algorithm. 

6. A method according to any of Claims 1 to 5, char- 
acterized in that the selected image is selected 
manually (324) based on the appearance of the 
product associated with the image. 

7. A method according to any of Claims 1 to 6, char- 
acterised by adaptively training the filter with the as- 
sociated image if the further processed value is in 
the first range. 

8. A method according to any preceding claim, where- 
in the processed values of each image in the sec- 
ond set are the dot product of the filter and each of 
the second set of images. 

9. A method according to any preceding claim, char- 
acterised by sub-dividing each of the acceptable im- 
ages into a plurality of image portions and perform- 
ing all of the foregoing steps upon at least some of 
the image portions individually. 

10. Apparatus for determining the acceptability of a 
product (1 2) by generating a filter (F) from a first set 
of acceptable images (I) of the product, comparing 
the filter with each of a second set of images of the 
product to produce a processed value (P) tor each 
image in the second set, the processed values hav- 
ing a distribution of values, comparing the filter with 
each of a third set of images of the product to pro- 
duce a further processed value for each image in 
the third set, and comparing each further processed 
value to the distribution to determine the accepta- 
bility of the product associated with the image hav- 
ing the further processed value, characterized by: 

means (26, 220) for generating from the distri- 
bution a first range (A) and a second range (B) 
of processed values, the first range comprising 
processed values associated with acceptable 
images of the product, and the second range 
being spaced from the first range and compris- 
ing processed values associated with unac- 
ceptable images of the product; 
means (26, 318, 322, 324) for determining 
whether each further processed value is out- 
side both of the first and second ranges and, if 
so, selecting the associated image only if said 
image is acceptable; and 
means (26, 334) for adaptively training the filter 
with the selected image to produce a modified 
filter whereby the comparison of the modified 
filter with the selected image produces a mod- 
ified processed value closer to the first range. 

11. Apparatus according to Claim 10, characterized in 
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that the filter is generated from the first set of ac- 
ceptable images of the product by means (26, 120) 
for combining the first set of acceptable images us- 
ing a logical OR operation. 

12. Apparatus according to Claim 11, characterised in 
that the means for combining the first set of accept- 
able images comprises: 

means (26, 108) for edge detecting each im- 
age; and 

means (26, 108) for associating a first value 
with each portion of each edge detected image 
which has a value on one side of a predeter- 
mined threshold value, and associated a sec- 
ond value with all other portions of each edge 
detected image prior to combining the images 
using the logical OR operation. 

13. Apparatus according to Claim 12, characterized in 
that the first and second values are binary 1 and 0. 

1 4. The apparatus as claimed in any of Claims 1 0 to 1 3, 
characterized in that the means (26, 334) for adap- 
tively training performs a function analogous to a 
Widrow-Hoff training algorithm. 

15. Apparatus according to any of Claims 10 to 14, 
characterized in that the means for determining in- 
cludes means (26, 324) for allowing manual selec- 
tion based on the appearance of the product asso- 
ciated with the image. 

16. Apparatus according to any of Claims 10 to 15, 
characterized by means (26) for adaptivety training 
the filter with an image associated with a further 
processed value which is in the first range. 

17. Apparatus according to any of Claims 10 to 16, 
characterized by means for forming the dot product 
of the filter and each of the second set of images to 
form the processed values of each image in the said 
second set. 

18. Apparatus according to any of Claims 10 to 17, 
characterized by a video camera (24) for forming at 
least one of the first, second and third sets of imag- 
es, and by means for positioning a product in the 
field of view of the video camera. 

19. Apparatus according to Claim 18, characterized by 
means for illuminating the product in the field of view 
of the video camera. 

20. Apparatus according to Claim 19 or 20, character- 
ized in that the positioning means comprises a con- 
veyor (20) for conveying products are after another 
through the field of view of the video camera. 



PatentansprOche 

1. Verfahren zur Bestimmung der Annehmbarkeit ei- 
nes Produkts (12) durch Erzeugen eines Filters (F) 

s aus einem ersten Satz annehmbarer Bilder (I) des 
Produkts, Vergleichen des Filters mit jedem Bild ei- 
nes zweiten Satzes Bilder des Produkts, urn einen 
verarbeiteten Wert (P) fur jedes Bild in dem zweiten 
Satz zu erzeugen, wobei die verarbeiteten Werte ei- 

10 ne Werteverteilung besitzen, Vergleichen des Fil- 
ters mit jedem Bild eines dritten Satzes Bilder des 
Produkts, um einen weiterverarbeiteten Wert fur je- 
des Bild in dem dritten Satz zu erzeugen, und Ver- 
gleichen eines jeden weiterverarbeiteten Wertes 

is mit der Verteilung, um die Annehmbarkeit des Pro- 
dukts, das zu dem Bild gehort, welches den weiter- 
verarbeiteten Wert hat, zu bestimmen, gekenn- 
zeichnet durch: 

20 Erstellen (220) eines ersten Bereichs (A) und 

eines zweiten Bereichs (B) verarbeiteter Werte 
aus der Verteilung, wobei dererste Bereich ver- 
arbeitete Werte umfaBt, die zu annehmbaren 
Bildem des Produkts gehoren, und der zweite 

25 Bereich getrennt vom ersten Bereich ist und 

verarbeitete Werte umfaBt, die zu unannehm- 
baren Bildern des Produkts gehoren, 
Bestimmen (318, 322, 324), ob jeder weiterver- 
arbeitete Wert sowohl auGerhalb des ersten als 

30 auch auBerhalb des zweiten Bereichs liegt, 

und, falls dies der Fall ist, Auswahlen des zu- 
gehorigen Bildes nur, wenn dieses annehmbar 
ist, und 

Adaptives Trainieren (334) des Filters mit dem 
35 ausgewahlten Bild, um einen modifizierten Fil- 

ter zu erzeugen, wodurch der Vergleich des 
modifizierten Filters mit dem ausgewahlten Bild 
einen modifizierten verarbeiteten Wert erzeugt, 
der naher am ersten Bereich liegt. 

40 

2. Verfahren nach Anspruch 1 , gekennzeichnet durch 
Erzeugen des Filters aus dem ersten Satz annehm- 
barer Bilder des Produkts, indem der erste Satz an- 
nehmbarer Bilder durch Anwendung einer logi- 
cs schen ODER-Verknupf ung kombiniert wird (1 20). 

3. Verfahren nach Anspruch 2, ferner dadurch ge- 
kennzeichnet, daB der Schritt der Kombination des 
ersten Satzes annehmbarer Bilder die Schritte um- 

so faBt: 

Detektieren (108) des Randes eines jeden Bil- 
des und 

Zuordnen (108) eines ersten Wertes zu jedem 
55 Teil eines jeden randdetektierten Bildes, das ei- 

nen Wert auf einer Seite eines vomer festge- 
setzten Schwellen wertes hat, und Zuordnen ei- 
nes zweiten Wertes zu alien anderen Teilen ei- 
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nes jeden randdetektierten Bildes vor der Kom- 
bination der Bilder durch Anwenden der logi- 
schen ODER-Verknupfung. 

4. Verfahren nach Anspruch 3, dadurch gekennzeich- 
net, daB die ersten und zweiten Werte binar 0 und 
1 sind. 

5. Verfahren nach irgendeinem der Anspruche 1 bis 

4, dadurch gekennzeichnet, daB das adaptive Trai- 
ning des Filters analog zu einem Widrow-Hoff-Trai- 
ningsalgorithmus ist. 

6. Verfahren nach irgendeinem der Anspruche 1 bis 

5, dadurch gekennzeichnet, daB das ausgewahlte 
Bild manuell ausgewahlt wird (324), basierend aut 
dem Aussehen des zu dem Bild gehorigen Pro- 
dukts. 

7. Verfahren nach irgendeinem der Anspruche 1 bis 

6, gekennzeichnet durch adaptives Trainieren des 
Filters mit dem zugehdrigen Bild, wenn der weiter- 
verarbeitete Wert im ersten Bereich liegt. 

8. Verfahren nach irgendeinem vorhergehenden An- 
spruch, bei dem die verarbeiteten Werte eines je- 
den Bildes im zweiten Satz das Skalarproduktdes 
Fitters und eines jeden Bildes des zweiten Satzes 
sind, 

9. Verfahren nach irgendeinem vorhergehenden An- 
spruch, gekennzeichnet durch Unterteilen eines je- 
den annehmbaren Bildes in eine Vielzahl von Bild- 
teilen und einzelnes Anwenden samtiicher vorher- 
gehender Schritte auf wenigstens einige der Bild- 
teile. 

1 0. Vorrichtung zur Bestimmung der Annehmbarkeit ei- 
nes Produkts (12) durch Erzeugen eines Filters (F) 
aus einem ersten Satz annehmbarer Bilder (I) des 
Produkts, Vergleichen des Filters mit jedem Bild ei- 
nes zweiten Satzes Bilder des Produkts, urn einen 
verarbeiteten Wert (P) fur jedes Bild in dem zweiten 
Satz zu erzeugen, wobei die verarbeiteten Werte ei- 
ne Werteverteilung besitzen, Vergleichen des Fil- 
ters mit jedem Bild eines dritten Satzes Bilder des 
Produkts, urn einen weiterverarbeiteten Wert fur je- 
des Bild in dem dritten Satz zu erzeugen, und Ver- 
gleichen eines jeden weiterverarbeiteten Wertes 
mit der Verteilung, urn die Annehmbarkeit des Pro- 
dukts, das zu dem Bild gehort, welches den weiter- 
verarbeiteten Wert hat, zu bestimmen, gekenn- 
zeichnet durch: 

Mittel (26, 220), urn aus der Verteilung einen 
ersten Bereich (A) und einen zweiten Bereich 
(B) verarbeiteter Werte zu erzeugen, wobei der 
erste Bereich verarbeitete Werte urnfaBt, die zu 



annehmbaren Bildern des Produkts gehoren, 
und der zweite Bereich getrennt vom ersten Be- 
reich ist und verarbeitete Werte urnfaBt, die zu 
unannehmbaren Bildern des Produkts geho- 

5 ren, 

Mittel (26, 318, 322, 324), urn zu bestimmen, 
ob jeder weiterverarbeitete Wert sowohl auBer- 
halb des ersten als auch auBerhalb des zweiten 
Bereichs liegt, und, falls dies der Fall ist, urn 

10 das zugehorige Bild nur auszuwahlen, wenn 

dieses annehmbar ist, und 
Mittel (26, 334) zum adaptiven Training des Fil- 
ters mit dem ausgewahlten Bild, urn einen mo- 
difizierten Filter zu erzeugen, wodurch der Ver- 

is gleich des modifizierten Filters mit dem ausge- 

wahlten Bild einen modifizierten verarbeiteten 
Wert erzeugt, der naher am ersten Bereich 
liegt. 

20 11 . Vorrichtung gemaB Anspruch 10, dadurch gekenn- 
zeichnet, daB der Filter aus dem ersten Satz an- 
nehmbarer Bilder des Produkts durch Mittel (26, 
120) zur Kombination des ersten Satzes annehm- 
barer Bilder durch Anwendung einer logischen 

25 ODER-Verknupfung erzeugt wird. 

12. Vorrichtung gemaB Anspruch 11 , dadurch gekenn- 
zeichnet, daB das Mittel zur Kombination des ersten 
Satzes annehmbarer Bilder urnfaBt: 

30 

Mittel (26, 108) zum Detektieren des Randes 
eines jeden Bildes und 

Mittel (26, 108) zur Zuordnung eines ersten 
Wertes zu jedem Teil eines jeden randdetek- 

35 tierten Bildes, das einen Wert auf einer Seite 

eines vorher festgesetzten Schwellen wertes 
hat, und zur Zuordnung eines zweiten Wertes 
zu alien anderen Teilen eines jeden randdetek- 
tierten Bildes vor der Kombination der Bilder 

40 durch Anwenden der logischen ODER-Ver- 

knupfung. 

13. Vorrichtung gemaB Anspruch 12, dadurch gekenn- 
zeichnet, daB die ersten und zweiten Werte binar 1 

45 und 0 sind. 

14. Vorrichtung gemaB irgendeinem der Anspruche 10 
bis 1 3, dadurch gekennzeichnet, daB das Mittel (26, 
334) zum adaptiven Training des Filters eine zu ei- 

50 nem Widrow-Hoff-Trainingsalgorithmus analogs 
Funktion ausubt. 

15. Vorrichtung gemaB irgendeinem der Anspruche 10 
bis 14, dadurch gekennzeichnet, daB das Mittel zur 

55 Bestimmung Mittel (26, 324) zur Ermoglichung ei- 
ner manuellen Auswahl, basierend auf dem Ausse- 
hen des zu dem Bild gehorigen Produkts, urnfaBt. 
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16. Vorrichtung gemaB irgendeinern der Anspruche 10 
bis 15, gekennzeichnet durch ein Mittel (26) zum 
adaptiven Training des Filters mit einem Bild, das 
zu einem weiterverarbeiteten Wert gehort, der im 
ersten Bereich liegt. s 

17. Vorrichtung gemaB irgendeinern der Anspruche 10 
bis 16, gekennzeichnet durch Mittel zur Bildung des 
Skalarprodukts des Filters und eines jeden Bildes 
des zweiten Satzes, um die weiterverarbeiteten 10 
Werte von jedem Bild in dem zweiten Satz zu bilden. 

18. Vorrichtung gemaB irgendeinern der Anspruche 10 
bis 17, gekennzeichnet durch eine Videokamera 
(24) zur Bildung von wenigsten einem Bild des er- 1& 
sten, zweiten und dritten Satzes und ein Mittel, um 

ein Produkt in das Sichtteld der Videokamera zu po- 
sition iereh. 

19. Vorrichtung gemaB Anspruch 18, gekennzeichnet 20 
durch Mittel zur Ausleuchtung des Produkts im 
Sichtfeld der Videokamera. 

20. Vorrichtung gemaB Anspruch 1 9 oder 20, dadurch 
gekennzeichnet, daB das Position ierungsmittel ein 25 
Fordermittel (20) zur Beforderung der Produkte 
nacheinander durch das Sichtfeld der Videokamera 
umfaBt. 



Revendications 

1. Proced6 permettant de determiner I'acceptabilit6 
d'un produit (12) en geYi6rant un filtre (F) a partir 
d'un premier ensemble d' images acceptables (I) du 35 
produit, en comparant le tiltre a chacune d'un 
deuxieme ensemble d'images du produit pour pro- 
duce une valeur traitee (P) pour chaque image du 
deuxieme ensemble, les valeurs traitees ayant une 
distribution de valeurs, en comparant le filtre a cha- 40 
cune d'un troisieme ensemble d'images du produit 
pour produire une autre valeur traitee pour chaque 
image du troisieme ensemble, et en comparant cha- 
que autre valeur trait6e a la distribution pour deter- 
miner I'acceptabilite du produit associe a I'image 45 
ayant Tautre valeur traitee, caracterise en ce que le 
procede* comprend les Stapes consistent : 

a generer (220) a partir de la distribution une 
premiere plage (A) et une seconde plage (B) so 
de valeurs traitees, la premiere plage compre- 
nant des valeurs traitees associees a des ima- 
ges acceptables du produit et la seconde plage 
etant espacee de ladite premiere plage et com- 
prenant des valeurs traitees associees a des ss 
images inacceptables du produit; 
a determiner (318, 322, 324) si chaque autre 
valeur traitee est en dehors a la fois de la pre- 



miere et de la seconde plages et, si c'est le cas, 
a s6lectionner I'image associee uniquement si 
ladite image est acceptable; et 
a entralner de maniere adaptative (334) le filtre 
avec I'image selectionn6e pour produire un fil- 
tre modifi6 de telle sorte que lacomparaison du 
filtre modifie a I'image s6lectionn6e produise 
une valeur traitee modified plus proche de la 
premiere plage. 

2. ProcedS selon la revendication 1 , caracteris6 en ce 
que la generation du filtre a partir du premier en- 
semble d'images acceptables du produit comprend 
la combinaison (120) du premier ensemble d'ima- 
ges acceptables en utilisant une operation loglque 
OU. 

3. Procede selon la revendication 2, caracterise par 
ailleurs en ce que l'6tape de combinaison du pre- 
mier ensemble d'images acceptables comprend les 
6tapes consistant : 

a d6tecter les bords (108) de chaque image; et 
a associer (1 08) une premiere valeur a chaque 
partie de chaque image dont les bords ont 6X6 
detected qui a une valeur sur un cote de ia va- 
leur de seuil pred6terminee, et a associer une 
seconde valeur a toutes les autres parties de 
chaque image dont les bords ont 6i6 d6tectes 
avantde combiner les images en utilisant l'op6- 
ration logique OU. 

4. Proc6de selon la revendication 3, caracteris6 en ce 
que la premiere et la seconde valeurs sont les va- 
leurs binaires 0 et 1 . 

5. Procecie selon les revendications 1 a 4, caracteris6 
en ce que I'entralnement adaptatif du filtre est ana- 
logue a un algorithme d'entratnement de Widrow- 
Hoff. 

6. Proc6de selon I'une quelconque des revendications 
1 a 5, caracteris6 en ce que I'image selectionnee 
est selectionnee manuellement (324) sur la base de 
I'aspect du produit assocte a I'image. 

7. Procede selon I'une quelconque des revendications 
1 a 6, caracteris6 par I'entralnement adaptatif du 
filtre avec Timage associee si Tautre valeur trait6e 
se situe dans la premiere plage. 

8. Proced6 selon I'une quelconque des revendications 
prec^dentes, dans lequel les valeurs traitees de 
chaque image du second ensemble sont le produit 
scalaire du filtre et de chacune du second ensemble 
d'images. 

9. Proc6d§ selon i'une quelconque des revendications 
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prec6dentes, caracterise" en ce que Ton subdivise 
chacune des images acceptables en une plurality 
de parties d'images et on effectue toutes les Stapes 
precitees sur au moins certaines des parties dama- 
ges individuellement. 

10. Appareil pour determiner I'acceptabilite d'un produit 
(12) en generant un filtre (F) a. partir d'un premier 
ensemble d'images acceptables (I) du produit, en 
comparant le filtre & chacune d'un deuxieme en- 
semble d'images du produit pour produire une va- 
leurtraitee (P) pourchaque image du deuxieme en- 
semble, les valeurs traitees ayant une distribution 
de valeurs, en comparant le filtre a. chacune d'un 
troisieme ensemble d'images du produit pour obte- 
nir une autre valeur traitee pour chaque image du 
troisieme ensemble, et en comparant chaque autre 
valeur traitee a. la distribution pour determiner I'ac- 
ceptabilite* du produit associ6 & I'image ayant I'autre 
valeur traitee, caracterise par : 

des moyens (26, 220) pour generer a. partir de 
la distribution une premiere plage (A) et une se- 
conde plage (B) de valeurs traitees, la premiere 
plage comprenant des valeurs traitees asso- 
ciees a des images acceptables du produit, et 
la deuxieme plage etant espacee de la premie- 
re plage et comprenant des valeurs traitees as- 
soci6es & des images inacceptab les du produit; 
des moyens (26, 318, 322, 324) pour determi- 
ner si chaque autre valeur traitee est exterieure 
d la fois a. la premiere et & la seconde plages 
et, si c'est le cas, k selectionner "'image asso- 
ci6e uniquement si ladite image est acceptable; 
et 

des moyens (26, 334) pour entraTner de manie- 
re adaptative le filtre avec I'image selectionn6e 
afin de produire un filtre modifie\ de sorte que 
la comparaison du filtre modif ie k I'image selec- 
tionn6e produise une valeur traitee modifiee 
plus proche de la premiere plage. 

11. Appareil selon la revendication 10, caracterise* en 
ce que le filtre est gen6re § partir du premier en- 
semble d'images acceptables du produit par des 
moyens (26, 120) pour combiner le premier ensem- 
ble d'images acceptables en utilisant une operation 
logique OU. 

12. Appareil selon la revendication 11, caracterise en 
ce que les moyens pour combiner le premier en- 
semble d'images acceptables : 

des moyens (26, 108) pour detecter les bords 
de chaque image; et 

des moyens (26, 108) pour associer une pre- 
miere valeur a chaque partie de chaque image 
dont les bords ont ete detected qui a une valeur 



sur un c6te de la valeur de seuil predetermined, 
et & associer une seconde valeur & toutes les 
autres parties de chaque image dont les bords 
ont 6X6 dStectes avant de combiner les images 
5 en utilisant I'operation logique OU. 

13. Appareil selon la revendication 12, caracterise en 
ce que la premiere et la seconde valeurs sont les 
valeurs binaires 0 et 1. 

10 

1 4. Appareil selon Tune quelconque des revendications 
1 0 & 1 3, caracterise en ce que les moyens (26, 334) 
pour I'entratnement adaptatif effectuent une fonc- 
tion analogue a. celle d'un algorithme d'entratne- 

15 ment de Widrow-Hoff . 

1 5. Appareil selon Tune quelconque des revendications 
10 & 14, caracteris6 en ce que les moyens de de- 
termination comprennent des moyens (26, 324) 

20 pour permettre une selection manuelle basee sur 
I'aspect du produit associe & I'image. 

1 6. Appareil selon Tune quelconque des revendications 
10 a. 15, caracterise par des moyens (26) pour I'en- 

25 tratnement adaptatif du filtre avec une image asso- 
ci6e a une autre valeur traitee qui se situe dans la 
premiere plage. 

17. Appareil selon I'une quelconque des revendications 
30 1 0 a 1 6, caracterise par des moyens pour former le 

produit scalaire du filtre et de chacune du deuxieme 
ensemble d'images pour former les valeurs traitees 
de chaque image dudit deuxieme ensemble. 

35 18. Appareil selon I'une quelconque des revendications 
10 a. 1 7, caracterise par une carrtera vid6o (24) pour 
former au moins Tun desdits premier, deuxieme et 
troisieme ensembles d'images et par des moyens 
pour positionner un produit dans le champ d'obser- 

40 vation de la camera video. 

19. Appareil selon la revendication 18, caracterise par 
des moyens permettant d'eclairer le produit dans le 
champ d'observation de la camera video. 

45 

20. Appareil selon la revendication 1 9 ou 20, caracteri- 
se en ce que les moyens de positbnnement com- 
prennent un transporter (20) pour acheminer les 
produits I'un apres I'autre a travers le champ d'ob- 

50 servation de la carrtera vid6o. 



55 
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FIG. I 
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TRANING PHASE U FORM AN INITIAL DISCRIMINANT FUNCTION FROM 
A RELATIVELY SMALL NUMBER OF " FIRST PHASE" IMAGES, EACH Of 
WHICH THE OPERATOR OF THE SYSTEM HAS DETERMINED TO BE AN 
ACCEPTABLE N AGE. USE THE INITIAL DISCRIMINANT FUNCTION TO 
COMPUTE AN AVERAGE PROCESSED VALUE FOR THE FIRST PHASE 
IMAGES. 



TRAINING PHASE 2: USE THE INITIAL DISCRIMINANT FUNCTION TO 
COMPUTE A PROCESSED VALUE FOR EtflfGFA RELATIVELY LARGE 
NUMBER OF " SECOND PHASE" IMAGES. COMPUTE THE STANDARD 
DEVIATION OF THE DISTRIBUTION OF THE PROCESSED VALUES. 
COMPUTE FIRST AND SECOND THRESHOLD VALUES FROM THE 
DISTRIBUTION, THE FIRST THRESHOLO VALUES BEING CLOSER TO 
Tl€ MEAN OF THE DISTRIBUTION THAN THE SECOND THRESHOLD 
VALUES. 



TO FIG. 2b 



FIG. 2a 
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FROM 


"IG. 2o 


,300 


TRAINING PHASE 3-' USE THE FIRST AND SECOND THRESHOLD VALUES TO DETERMINE WHICH OF 
A RELATIVELY LARGE NUMBER OF " THIRD PHASE" IMAGES TO USE IN PROGRESSIVELY REFINING 
THE DISCRIMINANT FUNCTION FOR FURTHER USE. IF THE PROCESSED VALUE RESULTING FROM USE 
OF THE CURRENT DISCRIMINANT FUNCTION ON A GIVEN THIRD PHASE IMAGE IS BE TWEEN THE FIRST 
THRESHOLD VALUES, USE THAT IMAGE TO REFINE THE DISCRIMINANT FUNCTION BEFORE PROCESSING 
THE NEXT THIRD PHASE WAGE, IF THE PROCESSED VALUE IS NOT BETWEEN THE SECOND 
THRESHOLD VALUES, DISCARO THAT IMAGE. IF THE PROCESSED VALUE IS NOT BETWEEN THE FRST 
THRESHOLD VALUES, BUT IS BETWEEN THE SECOND THRESHOLD VALUES, ALLOW THE OPERATOR 
OF THE SYSTEM TO DECIDE WHETHER THE IMAGE IS ACCEPTABLE. IF SO, USE THE IMAGE TO REFINE 
THE DISCRIMINANT FUNCTION BEFORE PROCESSING THE NEXT IMAGE. OTHERWISE DISCARD THE 
WAGE. 






y 400 




ACTUAL PROOUCT INSPECTlONtUSE THE REFINED 
DISCRIMINANT FUNCTION TO COMPUTE A 
PROCESSED VALUE FOR THE IMAGE OF EACH 
PRODUCT. IF THE PROCESSED VALUE IS 
BETWEEN THE FIRST THRESHOLD VALUES, 
ACCEPT THE PROOUCT.OTHE R WISE REJECT 
THE PRODUCT. 





FIG. 2 b 
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START TRAINING PHASE I -402 



INITIALIZE CONSTANTS AND REAO IfFUTS H04 



ACQUIRE FIRST ACCEPTABLE IMAGE - 






PREPROCESS IMAGE 







INITIALIZE THE DISCRIMINANT 


FUNCTION: 




F * I 
r xy *xy 





no 



INITIALIZE THE SUM OF THE OOT PRODUCTS 
OF THE DISCRIMINANT FUNCTION WITH THE 
PHASE I IMAGES: 



PSUM • Hi 



xy 



-II2 



FIG. 3a 



i-l 

T0FIG,3b 



-II4 
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FROM FIG. 3o 



ACQUIRE NEXT ACCEPTABLE IMAGE 



-II6 



PREPROCESS IMAGE 



-II8 



COMPUTE LOGICAL OR OF IMAGE DATA AND INITIAL 
DISCRIMINANT FUNCTION TO PRODUCE NEW NITIAL 
DISCRIMINANT FUNCTION: 



-I20 



update psum : 
psum-psumO;] 



-I22 



l»M -I24 



NO 



ISi >25? h'26 
YES 



TO FIG. 3c 



Ft G. 3b 
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FROM FIG. 3b 



CALCULATE AVERAGE DOT PRODUCT: 
?-PSUM/25 

I 

BEGIN TRAINING PHASE 2. 
SAVE F AND P 



FIG. 3c 
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FIG. 4a 



START TRAINING fWSE 2 



•202 







SUM-0 




SUMSORS- 0 



201 



RESCALE F AND F: 
IFF 



IF F, y -0— — F' Ky - -<r 



xy 
xy 

P- P-cT 



-205 



ACQUIRE IMAGE 



-206 



PREPROCESS IMAGE 



-208 



CALCULATE DOT PRODUCT P: 
P'-F'-I' 



•HF'-l' 



xy 



xy 



-2K) 







SUMSORS ■ 
M» 1 


SUMSORS* P'^P' 



NO 



-212 



IS i> 1000? ' 2 14 



YES 
TO FIG. 4b 
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FROM FIG. 4(1 



i-i- 



-216 



CALCULATE STANDARD DEVIATION*. 



SUM SQRS-i(P') 2 



-218 



CALCULATE FIRST THRESHOLD 
VALUES T ot AND T o2 ; 

CALCULATE SECOND THRESHOLD 
\AUJES Tbl AND T b 2 



-220 



BEGIN TRAINING PHASE 3, 
SAVE_T 0 , t T o2l Tbl. T b2. F ' 
AND P' 



FIG. 4b 
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START TRAINING PHASE 3 '302 



i-0 
nocc-0 



-3I0 



ACQUIRE W/CE 



-3I2 



PREPROCESS IMAGE 



~3W 



CALCULATE OOT PRODUCT: 
p.F' • t ' 



— 3I6 



TO FIG. 5b 



FIG. 5a 
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FROM FIG. 5a 



,318 



ISP<T b ,0RP>T b 2? 



NO 



YES 



OPERATOR RESPONDS 
THAT WAGE 6 NOT 
ACCEPTABUE 



i 



22 



REJECT IMAGE 



-320 



£ 



ISP<T Q ,ORP>T o2 ? 



NO 



YES 



,324 



OISPLAY IMAGE AND ASK 
OPERATOR IF IT IS ACCEPTABLE 



OPERATOR RESPONDS 
THAT IMAGE IS 
ACCEPTABLE 



nocc'fiocc* I 



326 



10 FIG. 5c 

FIG. 5b 
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FROM 



IG.5b 



CALCULATE "ERROR" IN OOT PROOUCT- 
ERR=F'-P 



-528 



CALCULATE NORM OF l' xy : N-l^I^y -529 



CALCULATE CORRECTION VALUE: 
CORRECT- ERR/N 



-330 



RESCALE I 1 FOR USE AS CORRECTION 
TOF': 

IF i', y =o— I' xy -0 

IF I' xy - 1 — r X y - CORRECT 



-332 



REFINE F': 

f ■ f ' »T' 



-334 



.i?..i.M -336 



YES 



IS i < 20001 



NO 



-338 



NO 



IS nocc/KTHRESHOLD? —340 



YES 



BEGIN ACTUAL PRODUCT INSPECTION —342 



FIG. 5c 
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START ACTUAL 
PROOUCT INSPECTION 








ACQUIRE MAGE -404 






PREPROCESS IMAGE 







-402 



-406 



CALCULATE OOT PRODUCT: 
P.f xy -I xy 



-408 



YES 



IS T 0 , < P < T^? 



-4I0 
NO 



ACCEPT 
PRODUCT 



REJECT 
PRODUCT 
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